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Abstract 

m ; 

We initiate the theory of communication complexity of individual inputs held by the agents, rather 
than worst-case or average-case. We consider total, partial, and partially correct protocols, one-way 
£N| ' versus two-way, with and without help bits. 
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1 Introduction 



Assume Alice has input x and Bob has input y and they want to compute a function f(x, y) by communicating 
information and local computation according to a fixed protocol P = (Pa, Pb) where Pa is the protocol 
executed by Alice, and Pg is the protocol executed by Bob. For definiteness assume that the requirement 
is that Alice outputs f(x,y). We are only interested in minimizing the number of bits communicated 
between Alice and Bob as in |SJ 0] . In the usual setting one considers the worst-case or average-case over 
all inputs x,y of given length n. However, in current situations like replicated file systems, and cache 
coherence algorithms, in multiprocessor systems and computer networks, the worst-case or average-case are 
not necessarily significant. The files or updates can be very large; but in real life they may typically be 
non-random and have considerable regularities or correlations that allow the communicated information to 
(~\| | be greatly compressible. Neither the worst-case not the average-case may be relevant; one wants to analyze 

the individual case. This gives also much more information: from the individual case-analysis one can easily 
derive the worst-case and the average-case, but not the other way around. Indeed, certain phenomena have 
no counterpart in more traditional settings: For example, there are inputs for Bob such that irrespective 
of Alice's input, every "simple" total protocol requires arbitrarily higher communication complexity than 
some more "complex" total protocol. Our results are expressed in terms of Kolmogorov complexity 
the minimal number of bits from which the data can be decompressed by effective computation. We use 
the "plain" Kolmogorov complexity denoted as C(x),C(x\y),C(x,y) for the absolute complexity of x, the 
conditional complexity of x given y, and the joint complexity of x,y. Increased compression of the data 
approximates the Kolmogorov complexity more and more, but the actual value is uncomputable in general. 
Given x, y, and assuming that Alice and Bob have a protocol P that works correctly on x,y, we study the 
individual communication complexity CC P (x,y) defined as the number of bits Alice with input x and Bob 
with input y exchange using protocol P. We refer to a standard definition of communication protocol jlj . 
We assume that the protocol identifies the length n of the strings on which it works. By the complexity of 
a protocol P we mean its plain Kolmogorov complexity conditional to n, denoted as C(P\n). 

Results and Related Work: We use the framework of communication complexity as in |5J0]. As far 
as we are aware there is no previous work on individual communication complexity. We formulate a theory of 
individual communication complexity, and first analyze the "mother" problem, the indentity function, where 
Alice outputs the input of Bob. Wc look at special functions such as the inner product, random functions, and 
the equality function. We then turn to the question of analyzing the communication complexity, with respect 
to the best protocol of given complexity, for the mother problem (identity function) . For total protocols that 
are always correct, the power of one-way protocols equals that of two-way protocols, but for partially correct 
protocols or partial protocols, two-way protocols are remarkably more powerful. We establish a relation with 
Kolmogorov's Structure function, and the existence of strange "non-communicable" inputs of possibly low 
Kolmogorov complexity for total protocols — for which the communication complexity of every total protocol 
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is necessarily very large (almost the literal uncompressed input needs to be communicated) unless all of the 
input is hard-wired in the protocol. It is shown that for partial protocols two-way is more powerful than 
one-way when we use help bits. 

2 The mother function: Identity 

We start with listing some easy facts that establish lower and upper bounds on individual communication 
complexity with respect to individual protocols P expressed in terms of C(y\n), C{y\P) and compared to 
C{y\x). We assume that the protocols do not depend on x,y, they are uniform, and they compute the 
function concerned on strings of length n. Let C be a constant such that C(y\n) < n + C for all y. 

Let I(x, y) = y be the identity function: Alice with input x and Bob with input y compute output y by 
Alice. This is the "mother" function: for if Alice can compute / then she can compute every computable 
function /. 

(1) For all n there is a protocol P of complexity n + O(l) to compute the identity function such that for 
all x, y of length n we have CCf(x, y) < C(y\n). 

Indeed, assume Bob knows L n = \{p \ \p\ < n + C, U(p) halts} |. (U is the reference universal Turing 
machine.) Then Bob can find all halting programs of length at most n + C by enumerating them until 
he obtains L n halting programs. This allows him to find a shortest program y* for y. He transmits that 
program to Alice and Alice computes y. The complexity of this protocol is C(L n ) + O(l) = n + 0(1). 

(2) The complexity bound n + O(l) on C(P\n) in item (1) is tight. For every protocol of complexity less 
than n the assertion of item (1) is false: for all P there are x, y such that CCf(x, y) > n but C(y\P) = 0(1) 
(and hence C(y\n) < C(P\n) + 0(1), that is C{y\n) is much smaller than CCf(x,y) if C(P\n) is much 
smaller than n). 

Indeed, let e be the empty string and let y be the first string such that CCf(e, y) > n (by counting arguments 
there is such y). 

(3) For every protocol P to compute identity function and for every x, y we have CCf(x, y) > C(y\P) — 
0(1). 

Let c be the conversation between Alice and Bob on inputs x, y. It suffices to prove that given P, c we can 
find y. It is known jl] that the set of all pairs (x',y') such that the conversation between Alice and Bob on 
input (x' , y 1 ) is equal to c is a rectangle, that is, has the form X xY, for some X, Y C {0, 1}™. The set Y is 
a one-element set, as for every y' &Y Alice outputs y also on the input (x, y') (the output of Alice depends 
on c, P, x only). We can find Y given P, c and since Y = {y} we are done. 

By item (2), for every protocol there are x, y such that the right hand side of the inequality CCf(x, y) > 
C(y\P) — O(l) is much less than its left hand side, more specifically, C(y\P) — 0(1) and CCf(x,y) > n. 

(4) How is CCf(x, y) related to C(y\x)7 By item (3) we have CCf{x, y) > C(y\x) - C(P) - 0(log C(P)) 
for all x,y. For all P this inequality is not tight for some x,y: there are x,y such that C(y\x) = O(l) but 
CCf(x,y) >n. 

Indeed, let x — y. We need to prove that for some x it holds CCf(x, x) > n. For every x let c(x) denote the 
conversation on the pair (x,x). For every x the set of input pairs (x',y') producing the conversation c(x) 
is a rectangle of height 1, as we have seen in item (3). Therefore c{x) are pairwise different for different x 
hence for some x we have \c(x)\ > n. 

(5) However, for some P, x, y the inequality CCf (x, y) > C(y\x) — C(P\n) — 0(log C(P\nj) is close to an 
equality: for all a there are P, x, y such that CCf(x, y) = C(y\x) — a + O(l) and C(P|n) < a + O(l). 
Indeed, let x be some string. Let y be a random string of length n, independent of x, that is, C(y\x) = 
n+ 0(1). Let P be the following protocol: Bob first looks whether his string y' has the same prefix of length 
a than y. If this is the case he sends to Alice and then n — a remaining bits of y' and Alice prefixes the 
n — a received bits by a first bits of y and outputs the resulting string. Otherwise Bob sends to Alice 1 and 
then y'. The complexity of this protocol is at most a + O(l), as both Alice and Bob need to know only the 
first a bits of y. And we have CCf(x,y) — n — a — C(y\x) — a + 0(1). 

3 Other functions 

Because Alice can compute every computable function once she knows Bob's input, we have CCj (x,y) < 
CC[(x,y), with C(P') < C(P,/) + 0(l). 
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The trivial lower bound on the individual communication complexity of a function / is CC P (x,y) > 
C(f(x,y) | x, P) — 0(1) (and hence TCCJ{x,y) > C(f(x,y) \ x) — a — O(loga) anticipating on a later 
defined notion). In this section we establish some nontrivial lower bounds on CC P (x,y) for P computing / 
on all arguments for the inner product function, the equality function and for random Boolean functions. 

3.1 Inner Product 

We extend an argument introduced in [2]. Initially, Alice has a string x = x\, . . . ,x n and Bob has a string 
y = y\, . . . ,y n with x, y S {0, 1}™. Alice and Bob compute the inner product of x and y modulo 2 

n 

f{x, y) = ^2 x i ■ Vi mod 2 

1=1 

with Alice ending up with the result. 

Theorem 1. Every deterministic protocol Pf computing the inner product function f (without help bits) 
requires at least CC P (x, y) > C(x,y \ P) — n — O(l) bits of communication on all x, y. 

Proof. Fix a communication protocol P that computes the inner product. Let Alice's input be X — X ~y . . , Xyi 
and Bob's input be y% . . . y n . Run the communication protocol P on x, y and let c{x, y) be the communication 
between Alice and Bob. Note that P can be viewed as a tree with c(x,y) a path in that tree @|. Hence 
c(x,y) form a prefix free set. Consider the set S = S(x,y) defined by 

S := {(a, b) | C(a,b) = C(x,y), and Alice outputs f(x,y) having the conversation C(x,y) and input a}. 

We claim that \S\ < 2™. To prove the claim assume first that f(x, y) = 0. Let X be the first projection X 
of S and Y be the second projection of S. Being an intersection of two rectangles, S is a rectangle too. As 
P computes / we know that /(a, b) — for all (a, 6) £ S. In other words, every element of X is orthogonal 
to every element in Y hence rank(A) + rank(F) < n. Thus |5| = \X\ ■ \Y\ < 2 rank W+ rank ( 5 < 2". Assume 
now that that f(x, y) = 1. Again S = X x Y for some X, Y and f(a, b) = 1 for all (a, b) 6 S. Subtracting x 
from the first component of all pairs in S we obtain a rectangle S' such that f(a,b) = for all (a,b) € S'. 
By above argument, we have \S'\ < 2". As \S'\ — \S\ we are done. 

Given P, C(x, y), f(x, y) and the index of (x, y) in S we can compute (x, y). By the prefix free property, 
C(x, y) and the index of (x, y) can be concatenated without delimiters. Consequently, C(x, y\P) < \c(x, y)\ + 
n + 0(l). □ 

Remark 1. The result of the theorem is only significant for C(x, y) > n, but it cannot be improved. Namely, 
CC p {x 7 y) > C{x,y | P) - n - 0(1) = C(y \x,P)-(n- C(x | P)) - O(logn), where the equality follows 
from the "symmetry of information" property of Kolmogorov complexity [H]. The term n — C(x | P) is 
a called the randomness deficiency of x with respect to P. Clearly, for x = 00 ... it is maximal with 
C(x | P) = O(logn) and Alice knows already from her input x that f(x,y) = and no bits, or only one bit, 
depending on the protocol conventions, need to be exchanged: CC P (x, y) = irrespective of the complexity 
of y which can be n. 

3.2 Random Functions 

Alice has X — X i . . . Xfi and Bob has yi . . . y n , and / : {0, l} 2 " — » {0, 1} satisfies 

C(f | n) > 2 2 " - n. (1) 

The latter condition means that the truth table describing the outcomes of / for the 2 n possible inputs x 
(the rows) and the 2™ possible inputs for y (the columns) has high Kolmogorov complexity. If we flip the 
truth table for a prospective / using a fair coin, then with probability at least 1 — 2~™ it will satisfy (JIJ. 

Theorem 2. Every deterministic protocol P computing a function f satisfying 0) (without help bits) requires 
at least CC?(x,y) >mm{C(x | P),C(y | P)} - logn - 0(1). 
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Proof. Run the communication protocol P on x,y and let c(x,y) be the communication between Alice and 
Bob. Consider the set S = S(x, y) defined by 

S = {(x ,y ) | c(x , y ) = c(x,y), and Alice outputs f(x,y) having the conversation c(x,y) and input x }. 

Then S* is a monochromatic rectangle in the function table of / (that is, /(a/, z/) = f(x, y) for all (x 1 ', y') S S). 
Suppose the rectangle 5 has dimensions a x b. Then we can describe / by giving f(x,y), the value of a in 
21oga + O(l) bits, the value of b in 21og& + O(l) bits, the positions of the rows of the rectangles an bits, 
the positions of the columns of the rectangles in bn bits, all of the table except the rectangle, in row-major 
order, in 2 2 " — ab bits. This description must have length at least the Kolmogorov complexity, so by Q we 
find 

2 2 " - ab + (a + b)n + 21og ab + 0(1) > 2 2n - n. 

Assume w.l.o.g. that b > a. Then a < in if n is large enough. (Otherwise we would have ibn < ab < 
(2b + l)n + 21og& 2 + 0(1).) Given the communication sequence c(x,y), n and f(x,y) we can find the 
rectangle S that it defines. Then, we can reconstruct x by indicating its row in the rectangle. Then 
C(x | P) < \c(x,y)\ +logn + 0(l). □ 

3.3 Equality and Functions with Large Monochromatic Rectangles 

Let / be the equality function, with f(x, y) = 1 if x = y and otherwise. 

Theorem 3. For every deterministic protocol P computing f we have CC p (x, x) > C(x \ P) — O(l) for all 
x,y. On the other hand there is P of complexity O(l) such that there are x,y (x ^ y) with C(x | P),C(y \ 
P)>n-1 for which CC P (x, y)=2. 

Proof. Lower bound: Since trivially the communication sequence must be different and uniquely identify x 
if both Alice and Bob have input x, we have also CCj(x, x) + O(l) > C(x \ P). 

Upper bound: In the function table the lower left rectangle consisting of all x's beginning with and all 
y's beginning with 1 is monochromatic (entries are all 0). Thus, a protocol where Bob communicates one bit 
to Alice indicating whether x starts with allows Alice, in case y starts with 1, to output 0. Otherwise Alice 
and Bob start the default protocol. Thus, for such x, y and P we have CC p (x, y) — 2. By simple counting 
for some such inputs we have C(x | P), C(y \ P) > n — 1. □ 

Generalizing this idea, every function that contains large monochromatic rectangles, of size say 2 2n /n°( 1 > , 
has many pairs x, y of complexity close to n for which the individual communication complexity drops to 
O(logn), as follows: 

In round 1 Bob tells Alice in which large rectangle (if any) his input is situated, by sending the index of 
the rectangle to Alice, and otherwise. If Bob did send an index, and Alice's input is in that rectangle as 
well, then Alice outputs the color ("0" or "1") of the rectangle. Otherwise, Alice starts a default protocol. 

4 Total protocols 

Let / be a function defined on pairs of strings of the same length. Assume that Alice has x, Bob has y and 
Alice wants to compute f(x,y). As the complexity measure we consider the number of bits communicated 
between Alice and Bob. The naive definition of the individual communication complexity of the value of 
the function / on the argument (x, y) is the number of communicated bits in the "best" communication 
protocol. Then, for every x, y there is a protocol with no communication at all on (x, y): the string y is hard 
wired into the protocol. To meaningfully capture the individual communication complexity of computing a 
function f(x,y) we define now the following notion. 

Definition 1. Let a be a natural number parameter. Let TCCJ[x : y) stand for the minimum CC P (x,y) 
over all total protocols P of complexity at most a that always compute / correctly (being total such a 
protocol terminates for all inputs, and not only for (x,y)). 

For a = n + O(l) we have TCCJ(x,y) — for all computable / and all x, y, since we can hard 
wire y into the protocol. Therefore it is natural to consider only a that are much smaller than n, say 
a = 0(log n). Since computation of the Identity function suffices to compute all other (recursive) functions we 
haveTOO^ + ° (1) (a;,7/) < TCCf{x,y). The trivial lower bound is TCCf (x, y) > C(f(x,y) \ x)-a-0{\oga). 
For / = / this gives TCCf (a;, y) > C(y \ x) - a - O(loga). 
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4.1 One-way equals two-way for Identity 

Let TCCJ !_ way (a;, y) stand for the minimum TCC p (x,y) over all one-way (Bob sends a message to Alice) 
total protocols P of complexity at most a computing / (over all inputs, and not only on [x, y)). It is clear 
that TCCJ^ {x, y) does not depend on x: indeed, consider for given (x,y) the best protocol P; that 
protocol sends the same message on every other pair (x',y) hence TCCJ^ (x',y) < TCCJ^ {x,y). 
Therefore we will use the notation TCCj"(y) dropping both x and "1-way". Obviously, 

TCCf(x,y)<TCCf(y) 

for all a, x, y, f. 

Surprisingly, for f = I, the Identity function, this inequality is an equality. That is, for total protocols 
"1-way" is as powerful as "many-way." More specifically, the following holds. 

Theorem 4. There is a constant C such that for all a, x, y we have 

TCC? +c (y)<TCC?(x iy ). 

Proof. Pick a two-way protocol P witnessing TCC"(x, y) = I. Let c — c(x, y) be the conversation according 
to P between Alice and Bob on inputs x,y. It is known that the set of all pairs (x',y') such that the 
conversation between Alice and Bob on input (x 1 , y') is equal to c is a rectangle, that is, has the form X x Y, 
for some X, Y C {0, 1}™. The set Y is a one-element set, as for every y' EY Alice outputs y also on the 
input (x,y') (the output of Alice depends on c,P,x only). 

Consider the following 1-way protocol P'\ find an x' with minimum c(x',y) and send c(x',y) to Alice. 
Alice then finds the set of all pairs (x",y') such that the conversation between Alice and Bob on input 
(x",y') is equal to c(x',y). As we have seen that set has the form X x {y} for some X. Thus Alice knows 
y. As \c{x',y)\ < \c(x,y)\ = TCCf{x,y) and C(P'\P) = 0(1) we are done. □ 

4.2 Non-Communicable objects 

The function TCCf(y), as a function of y, a, essentially coincides with Kolmogorov structure function h y (a) 
studied in [31 El ■ The latter is defined by 

h y (a) = nfinjlog \S\ : S 3 y, C(S) < a}, 

where S is a finite set and C(S) is the length (number of bits) in the shortest binary program from which 
the reference universal machine U computes a listing of the elements of S and then halts. More specifically 
we have 

TCC? + °V(y)<h y (a), (2) 
h y (a + 0(\ogn)) <TCCf(y). 

To prove the first inequality we have to transform a finite set S 9 y into a one-way protocol P of 
complexity at most a = C(S) + 0(1) witnessing TCCf{y) < log \ S\. The protocol just sends the index of y 
in S, or y literally if y £ S. 

To prove the second inequality we have to transform a one-way total protocol P into a finite set S 3 y 
of complexity at most C(P) + O(logra) with log |5| < CC p (y). The set consists of all y' on which P sends 
the message of the same length I as the length of the message on y. Obviously, |5| < 2 l = 2 CC ^ and to 
specify S we need a program describing P and I. Thus C(S) < C(P) + 0{\ogTCCf (y)) < C{P) + 0(log n). 

For the properties of h y (a), which by Theorem 01 are also properties of TCCf(x,y), its relation with 
Kolmogorov complexity C(y) of y and possible shapes of the function a h y (a) we refer to 

We will present here only a few properties. First, two easy inequalities: For all a > 0(1) and all x,y we 
have 

C{y\n) -a- 0{\oga) < TCCf(y) <n-a + 0(1). (3) 

The first inequality is the direct consequence of the inequality C(y\n) < CC p (y) + C(P\n) + 0(\ogC(P\n)), 
which is trivial. To prove the second one consider the protocol that sends n — a + C bits of y (for appropriate 
constant C) and the remaining a bits are hardwired into the protocol. Its complexity is at most a— 0+0(1) < 
a for appropriate choice of O. 
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The second property is not so easy. Given y, consider values of a such that 

TCCf(y)+a = C(y)+0(l). (4) 

That is, the protocol P witnessing (0} together with the one-way communication record Bob sends to Alice 
form a two-part code for y that is — up to an independent additive constant — as concise as the shortest one- 
part code for y (that has length C{y) by definition). Following the usage in |S| we call P a "sufficient" protocol 
for y. The descriptions of the protocol plus the communication precisely describe y, and in fact, it can be 
shown that the converse holds as well (up to a constant additive term) . There always exists such a protocol, 
since the protocol that contains y hard wired in the form of a shortest program of length C(y) satisfies the 
equality with a = C(y) + 0(1) and TCCf(y) = 0. By definition we cannot have TCCf (y)+a < C(y)-0(1), 
but for a sufficiently small we have TCCf(y)+a > C(y) + 0(\). In fact, for every form of function satisfying 
the obvious constraints on TCCf there is a y such that TCCf(y) realizes that function up to logarithmic 
precision. This shows that there are essentially non-communicable strings. More precisely: 

Theorem 5. For every k < n and monotonia decreasing function h(a) on integer domain [0, k] with h(0) = 
n, h(k) — 0, C{h) — O(logn), and h(a) + a > k for a G [0, k], there is a string y of length n and C{y) = k 
such that 

TCCf + ° {losn) (y)<h(a), 
h(a + 0(\ogn)) < TCCf{y). 

The proof is by combining Theorem 1 of [H] with In particular, for every k < n — O(logn) there are 
strings y of length n and complexity k such that TCCf(y) > n — a for all a < k~ O(logn) while TCCf(y) = 
O(l) for a > fc + 0(l). We call such strings y non-communicable. For example, with k — (logn) 2 this shows 
that there are y of complexity C(y) = (logn) 2 with TCCf{y) = n — (logn) 2 for all a < C(y) — O(logn) and 
O(l) otherwise. That is, Bob can hold a highly compressible string y, but cannot use that fact to reduce the 
communication complexity significantly below |y|! Unless all information about y is hard wired in the (total) 
protocol the communication between Bob and Alice requires sending y almost completely literally. For such 
y, irrespective of x, the communication complexity is exponential in the complexity of y for all protocols of 
complexity less that that of y; when the complexity of the protocol is allowed to pass the complexity of y 
then the communication complexity suddenly drops to 0. 

Corollary 1. For every n,k with k < n there are y of length n and C(y) = k such that for every x 
TCCf{x,y) > n — a for a < C(y) — O(logn); while for every x,y we have TCCf{x,y) — 0(1) for a > 
C(y) + 0(l). 

This follows by combining Theorems 0] |3J If we relax the requirement of total and correct protocols to 
partial and partially correct protocols then we obtain the significantly weaker statements of Theorem and 
Corollary [2 

5 Partially correct and partial protocols 

The individual communication complexity can decrease if we do not require the communication protocol to 
be correct on all the input pairs. Let CCf.(x, y) stand for the minimum CC p (x, y) over all P of complexity 
at most a computing / correctly on input (x,y) (on other inputs P may output incorrect result). The 
minimum of the empty set is defined as oo. Let CC" l way (x,y) stand for the minimum CC p (x,y) over all 
one-way (Bob sends a message to Alice) P of complexity at most a computing f{x, y) (again, on other inputs 
P may work incorrectly). For instance, if / is a Boolean function then CC°^} W {x, y) = for all x, y (either 
the protocol outputting always or the protocol outputting always 1 is computes f(x,y) for specific pair 

5.1 Partially correct and partial protocols versus total ones 

It is easy to see that in computing the Identity function for some (x, y) total, partially correct, protocols are 
more powerful than totally correct ones. A total partially correct protocol P computes f(x, y) correctly for 
some (x,y), but may err on some inputs (u, v), in which case we set CC P (x,y) = oo. Being total such a 
protocol terminates for all inputs. 
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Definition 2. Let a be a natural number parameter. Let CC^(x, y) stand for the minimum CC p (x, y) over 
all total partially correct protocols P of complexity at most a. 

For instance, for every n there is a total protocol P = P n computable from n such that CCf 1 _ way (x, x) = 

(Alice outputs her string), thus CCf^\x.x) — 0. On the other hand, for random x of length n we have 

TCCf(x,x) > TCCj~° {1) (x) >C(x\n)-a-0{\oga) > n - a - O(loga). 

We also consider partial protocols that on some x, y are allowed to get stuck, that is, give no instructions 
at all about how to proceed. Formally, such a protocol is a pair of programs (Pa, Pb)- The program Pa tells 
Alice what to do for each c (the current part of the conversation) and x: either wait the next bit from Bob, 
or to send a specific bit to Bob, or to output a certain string and halt. Similarly, the program Pb tells Bob 
what to do for each c and y: either to wait the next bit from Alice or to send a bit to Alice, or to halt. This 
pair must satisfy the following requirements for all (ar, y) 6 {0, 1}™ and all c: if a party gets the instruction 
to send a bit then another party gets the instruction to wait for a bit. However we do not require that for 
all (x,y) € {0, 1}™ and all c both parties get some instruction, it is allowed that Pa, Pb start some endless 
computation. In particular, Alice may wait for a bit and at the same time Bob has no instruction at all. 

Definition 3. The complexity of a partial protocol P — (Pa,Pb) is defined as C(P\n). We say that P 
computes / on the input (x, y) if Alice outputs f(x, y) when Pa, Pb are run on (x, y). On other pairs Alice 
is allowed to output a wrong answer or not output anything at all. If protocol P does not terminate, or gives 
an incorrect answer, for input [x, y), then CC P (x 1 y) = oo. Two-way and one-way individual communication 
complexities with complexity of the partial protocol upper bounded by a are denoted as PCC^(x,y) and 
PCCf A _ wa:y (x,y) respectively. 

Since the total, partially correct, protocols are a subset of the partial protocols, we always have PCCj* (x,y) < 
CCj(x, y) < TCCj*(x, y). Consider again the Identity function. We have the following obvious lower bound 

C(y\x)-a-0{\ogot)<PCC?{x,y) (5) 
for all a, x, y. On the other hand we have the following upper bound if a is at least log C(y) + O(l): 

PCC^ +0{1 \x,y)<C{y). (6) 

Indeed, we hardwire the value C(y) in the protocol using logC(y) bits. This enables Pb to find a shortest 
description y* of y and to send it to Alice; subsequently Pa decompresses the message received from Bob. 
Note that the program Pb gives no instruction to Bob if the complexity of Bob's input is greater than C(y). 
Therefore, this protocol is not total. Comparing Equation JBJ to Equation @ we see that for PCC we have 
a better upper bound than for TCC . It turns out that for some pairs (x, y) the communication complexity 
for totally correct (and even for partially correct) protocols is close to the upper bound n — a while the 
communication complexity for partial protocols is close to the lower bound C(y\x) ~ a <C n. 

Theorem 6. For all a, n, x there are y of length n such that CCf(x, y) > n — a and C(y\x) < a + O(l). 

Proof. Fix a string x. By counting arguments, there is a string y with CCf(x, y) > n — a. Indeed, there are 
less than 2 a+1 total protocols of complexity at most a. For each total protocol P there are at most 2™~ Q ~ 1 
different y's with CC p (x 1 y) < n — a. Therefore the total number of y's with CCf(x, y) < n — a is less than 

t^a+l^n — a — 1 2 n 

Let y be the first string with CC"(i, y) > n — a. To identify y conditional to x we only need to now the 
number of total protocols of complexity at most a: given that number we enumerate all such protocols until 
we find all them. Given all those protocols and x we run all of them on all pairs (x, y) to find CCf(x,y) 
(here we use that the protocols are total) for every y, and determine the first y for which it is at least n — a. 
Hence C(y\x) < a + 0(1). □ 

Corollary 2. Fix constants C\,C2 such that CC'] ^^}^^ 01 (x, y) < C(y) < n + C2- Applying the theorem 
to the empty string e and to (say) a = 21ogn we obtain a y of length n with exponential gap between 
CCf osn (e, y) > n - 21ogn - 0(1) and PCC\°f_ n w + a ^ )+Cl (e, y) < C(y) <\ogn + O(l). 

Using a deep result of An. Muchnik we can prove that PCCf^ is close to C(y\x) for a > O(logn) 
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Theorem 7 (An. Muchnik). For all x,y of length n there is p such that \p\ < C(y\x) + O(logn), 
C(p\y) = 0(logn) and C(y\p,x) = O(logrt), where the constants in O(logn) do not depend on n,x,y. 

Corollary 3. For all x, y of length n we have PCCf^°^™ y \x, y) < C(y\x) + O(logn). 

Proof. Let p be the program of Muchnik's theorem, let q be the program of length 0(log n) for the reference 
computer to reconstruct p from y and let r the program of length O(logn) for the reference computer to 
reconstruct y from the pair (x,p). The protocol is as follows: Bob finds p from y, q and sends p to Alice; 
Alice reconstructs y from x,r. Both q and r are hardwired into the protocol, so its complexity is O(logn). 
This protocol is partial, as both Bob and Alice may be stuck when reconstructing p from y' , q and y from 
x',r. □ 

For very small values of C(y\x),C(y) we can do even better using the coloring lemma 3.9 and theorem 
3.11 from p. 

Lemma 1. Let k\,k 2 be such that C(x) < k\ and C(y \ x) < k2, and let m = \{(x,y) : C(x) < k±, C(y \ 
x ) < fell- For M = 2 1 , N = 2 k2 and every 1 < B < N Bob can compute the recursive function 
R{ki,k 2 ,m, y) = r y < (N/B)e(MN) 1 / B such that Alice can reconstruct y from x,r y ,m and at most b < log B 
extra bits. 

Using ki, k 2 ,m,y. Bob can compute r y and send it in logr y bits to Alice. The latter computes y from 
x,m,r y using additionally b < \ogB special bits provided by the protocol. Then, the number of bits that 
need to be communicated, 1 round, from Bob to Alice, is 

1 ^ 1 1 D , ^ + fa 

logr y < k 2 ~ log B H — . 

The protocol P = (P A , P B ) uses < 2(fci + k 2 ) + b + 0(1) bits. 

Corollary 4. If C(x),C(y\x) = O(loglogn) and b = 9(loglogn) then PCCffj^ n) (x,y) < C(y\x) - 
0(log logn). 



5.2 Two-way is better than one-way for partially correct protocols 

Note that for the Identity function all our upper bounds hold for one-way protocols and all our lower bounds 
hold for two-way protocols. The following question arises: are two-way protocols more powerful than one- 
way ones (to compute the Identity function)? Theorem 0] implies that for total protocol it does not matter 
whether the communication is one-way or two-way. For partially correct total protocols and partial protocol 
the situation is different. It turns out that partially correct total two-way protocols are stronger than even 
partial one-way protocols. 

Theorem 8. For every k,l,s such that k > s + 12 s there are strings x,y of length (2 s + l)k such that 
CCf (1) (x,y) < 2 s log(2fc) but PCCf a _ way {x,y) > I. 

Proof. We let x — zqZ\ . . . 22 s where zq, . . . , have length k and y = ZjOO . . . for some j. 

To prove the upper bound consider the following two-way protocol: Alice finds a set of indexes / = 
{il, ...,12=} such that for every distinct j, m there is i € / such that ith bit of Zj is different from ith bit of 
z m (such set does exist, which may be shown by induction). Then she sends to Bob the string i\ . . . i 2 ° and 
Bob sends to Alice ith bit of y for all i £ I. Alice knows now y. 

We need to find now particular zq,z\,..., z 2 a+t+s such that no one-way protocol is effective on the pair 
(x,y) obtained from them in the specified way. To this end let Pi,..., Pat be all the one-way partial 
protocols of complexity less than s computing the identity function. For every z and i < N let c(z, i) denote 
the message sent by Bob in protocol P, when he receives zOO ... as help bits provided the length of the 
message is less than I, Otherwise let c(z,i) = 00. Let c(z) stand for the concatenation of c(z,i) over all i. 
The range of c(z) has (2')^ < 2 12 elements. Hence there is c such that for at least 2 fc ~ 2 1 > 2 s different z's 
we have c(z) = c. Pick such c and pick different zq, Zi, ... , z 2 s among those z's. Let yj stand for the string 
obtained from Zj by appending Os. We claim that CCp (x,yj) > I for some j for all i < N. Assume that 
this is not the case. That is, for every j there are i such that CCp (x,yj) < I. There are j\ ^ j 2 for which 
i is the same. As c(zj 1 ,i) — c(zj 2 ,i) ^ 00 Alice receives the same message in Pi on inputs (x, yj ± ), {x,yj 2 ) 
and should output both answers yj 1 , yj 2 , which is a contradiction. □ 
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Corollary 5. Let in the above theorem s = (log/c)/3 and I = fc 2 / 3 /logfc. These values satisfy the condition 
k > s + 12 s and hence there are x, y of length about fc 4 / 3 with almost quadratic gap between CCf^ (x, y) < 
fcV 3 logfc and PCCf°^^Jf(x,y) > fc 2 / 3 /logfc. Letting s = loglogfc and I — fc/(21ogfc) we obtain x,y of 

length about fclogfc with an exponential gap between CC^ X \x,y) < logfclog(2fc) and PCC] oe [ k way (x,y) > 
fc/(21ogfc). 

6 Summary of some selected results for comparison 

• y x , v ATCCf{x,y) > CCf{x lV ) > PCCf(x,y)] by definition. 

• V a , x , v [TCC? +0{1 \y) = TCCf{x,y) + 0(1)] Theorem H and discussion. 

• ^ n^k^OL^y^\y \— n,C(y) — ki x [ot < C(y) - O(logn) =4* TCCf(x,y) > n — a] Corollary^ 

• V X)3/ , a [a > C(y) - 0(1) =► TCCf(x,y) = 0(1)] CorollaryU] 

• V n , x , a 3 y ,\y\= n [a > C(y\x) - 0(l)kCCf(x, y) > n - a] TheoremEl 

• V x , y , a [PCCf(x,y)>C(y\x)-a-0{loga)] ©. 

• Vn, x jPCC?fi% + °V(x,y)<C(y)] ©. 

• ^ x ,vAx\=\ y \= n [PCCf^ y (x,y) <C(y\x) + 0(logn)} CorollaryE] 

• Vkj, S :k>s + i2s3 x ,y^ x \=\y\=(2s + i)k[CC? (1 \x,y) < 2° log(2fe) &PCCI ! „ way (x , y ) > I] TheoremEl 

7 Protocols using help bits 

A (partial) protocol with a help bits for Alice b help bits for Bob on strings of length n may be defined as 
a regular (partial) protocol P on inputs u, v of length n + a,n+ b, respectively. We say that P computes / 
on the input (x, y) if there are hA G {0, 1}° and hs S {0, l} 6 such according to P on input (xh,A,yhB) Alice 
outputs f(x,y). The crucial point in this definition is that the help bit sequences hA,hs may depend on 
the input pair (x,y). We say that P computes / if it computes / on all input pairs (x, y) € {0, 1}". Thus 
P may compute many different functions. For instance there is a protocol with 1 help bit for Alice and no 
help bits for Bob that computes every Boolean function: Alice just receives the value of the function as the 
help bit and outputs it. Define CC p (x, y) as the minimum of the length of conversation on input {xHa, yhs) 
according to P over hA G {0,1}°, hs 6 {0, l} b such that on input (xhA,yhB) Alice outputs f(x,y) (the 
minimum of the empty set is defined as oo). We define TCCf '°" (x,y) as the minimum CC P (x,y) over all 
P of complexity at most a computing / (over all inputs, and not only on (x.y)). Define TCCj'"j W3y (x,y) 

CCf' a ' b (x, y), CC"f_'^ ay (x,y) analogously (in the latter two we minimize over all P of complexity at most 
a). 

7.1 Partially correct protocols versus total ones — with help bits 

In contrast to the no-help-bit case, now the difference between totally and partially correct protocols in not 
essential: allowing only one extra help bit we can effectively transform a protocol P computing / on specific 
input (x,y) into a protocol P' computing / an all inputs so that TCC P (x,y) < CC P (x,y): at first Alice 
and Bob receive 1 bit of help information (or only one of them, and in that case he/she resends that bit to 
the other; in this case the right hand side of the inequality should be incremented by 1). If this is the case 
then they start P. Otherwise they start the default protocol. So we obtain 

TCC] + ° {l) ' a+1 ' b+ \x,y) < CC^ b (x,y), 
TCC a+o(i),a,b+i^ y) < cCf a ' h {x, y) + 1, 

TCC] +0(1) ' a+1 ' b {x 1 y) < CC^ b {x, y) + 1. 

The same applies to TOOi_ way and OOi_ way (except the last inequality, as now Alice is unable to send 
to Bob). Therefore we will not consider specially totally correct protocols. We will study only values 
CC^ b (x,y),CC^l y (x,y). 
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Moreover, we can decrease a by a' at the expense of increasing a by a 1 + b' + 0(logb') (help bits are 
appending to the program specifying the protocol), and similarly for b: 

cca +a'+b'+0^a'b'),a,b {x ^ ) < C(J a,a+a' ,b+b' ^ y ^ 

but not vice verse. The same is true for 1-way protocols. 

7.2 Partial protocols with help bits 

For partial protocol we can even decrease a at the expense of increasing both a and b: indeed let p be the 
shortest program for (Pa, Pb) and let q we the prefix of p and r be the remaining bits of p. Consider now 
the following programs P A , P' B ; both receive r as help an both have p hard wired. Pa appends computes 
p = qr and decompresses p and then executes Pa- The program Pb acts in a similar way. Note that 
C(P' A ,P' B ) < \q\ + 0(1). Thus we obtain 

pcc ,a + 0(l),a +Q '+0(loga'),6+«'+0(log Q ') (;z . ;2/) < pQC^' ^ (x , y) . 

7.3 Two-way is better than one-way with help bits 

Theorem 9. For every k,l,s,a,b such that k > a + b + s + l2 s+b there are strings x,y of length (2 a+b+s + l)fc 
such that there is a two-way protocol of complexity 0(1) with 1 help bit (either for Alice or for Bob) such 
that CC P (x, y) < 2 a+b+s log(2fc) + 1 but for every one-way protocol P of complexity less than s with a help 
bits for Alice and b help bits for Bob we have CC P (x,y) > I. 

Proof. The proof is similar to the proof of the previous Theorem |SJ 

We let x — zqZi . . . z 2 a+b+„ where Zq, . . . , z 2 a+b+ s have length k and y — z^OO ... for some j. 

To prove the upper bound consider the following two-way protocol: if x, y has not the above form Alice 
receives as the help bit and starts the default protocol. Otherwise she receives 1 as the help bit and finds 
a set of indexes / = {i\, . . . , i 2a +b+ s } such that for every distinct j, m there is i 6 / such that ith bit of Zj is 
different from ith bit of z m . Then she sends to Bob the string Hi . . . i 2 a+b+ s and Bob sends to Alice ith bit 
of y for all i S J. Alice knows now y. 

We need to find now particular zq, Zi, . . . , z 2 a+b+ s such that no one-way protocol is effective on the pair 
(x, y) obtained from them in the specified way. To this end let Pi, ... , Pn be all the one-way protocols of 
complexity less than s with a help bits for Alice and b help bits for Bob computing the identity function. 
For every z, i < N and hs where hs is a binary sequence of length b let c(z, i, hs) denote the message sent 
by Bob in protocol Pi when he receives zOO ... as the input and hs as help bits provided the length of 
the message is less than I. Otherwise let c(z, i, hs) = oo. Let c(z) stand for the concatenation of c(z, i, Kb) 
over all i,h B - The range of c(z) has (2 l ) N2b < 2 i2 ° + elements. Hence there is c such that for at least 
2fe-2 s+6 i > 2 a + b + s different z's we have c(z) = c. Pick such c and pick different zo, Z\, . . . , Z2*+>>+s among 
those z's. Let yj stand for the string obtained from Zj by appending Os. We claim that TCC Pi (x,yj) > I 
for some j for all i < N. Assume that this is not the case. That is, for every j there are i, Ha, hs such that 
TCC Pi (x, yj) < I with help bit sequences Jia, hs- There are ji ^ j 2 for which the triples (i, Ha, hs) coincide. 
As c(zj 1 ,i,h,B) = c(zj 2 ,i,liB) ^ oo Alice receives the same message in Pi on inputs (x,yj x ), (x,yj 2 ), with 
the help bit sequences Ha, hs and should output both answers yj t , yj 2 , which is a contradiction. □ 

Corollary 6. Let in the above theorem a = b = s = (logfe)/6, I = k 1 ' 2 /logk. These values satisfy the 
condition k>a + b + s + I2 s+b and hence there are x,y of length about k 1 ' 5 for which there is a two-way 
protocol of complexity 0(1) with only one help bit with CC P (x,y) < fc 1 / 3 logfc but there is no one-way 
protocol of complexity (logfc)/6 with (logfc)/6 help bits both for Alice and Bob with CC P (x,y) < k 1 / 2 / \ogk. 
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